As industry leaders urge a global slowdown in artificial intelligence development for the sake of humanity, the two superpowers driving the technology's rapid advancement have given no indication they intend to hit the brakes. The United States and China, which are locked in a fierce strategic rivalry, have each rebutted calls to slow the pace of AI development, even as industry executives and researchers stress the need for international cooperation to avoid exposing humans to catastrophic - or even existential - risks. Observers anticipated measures that, at best, would fall far short of the coordinated slowdown that many experts said is needed. "The two countries host nearly all frontier labs and most of the models people download," said Alvin Wang Graylin, a senior fellow at the Asia Society Policy Institute's Center for China Analysis, describing agreed guardrails between the US and China as "close to a precondition" for safe AI. "A safety regime covering one side's models covers half the problem," Wang Graylin said. Hampering the prospects for US-China cooperation, analysts said, are mutual mistrust and divergent perceptions of the primary risks involved.

With AI models from major companies all recently breaking out of their constraints, California's governor proposed creating a "kill switch" as part of a comprehensive solution. In an executive order signed by Gavin Newsom on Friday, California will convene national experts to create new recommendations for AI safety during a two-month time frame. "We're going to speed up our work on substantial and responsible AI oversight before it's too late," Newsom said in a press release. "We're going to do this thoughtfully but with urgent velocity; the stakes are too high to wait or delay action." The panel of experts will be tasked with submitting recommendations to Newsom's office, which would then update state laws surrounding AI safety.

Follow this section to personalize your feed and get instant alerts. Follow Go to your personalized feed WHY FOLLOW? Smart Alerts: Get notified about major news as it happens. Follow this tag to personalize your feed and get instant alerts. Follow Go to your personalized feed WHY FOLLOW?

Rumman Chowdhury, CEO and founder of the nonprofit Humane Intelligence, understands the concerns expressed by the DSA working group. Chowdhury, who formerly led the machine learning ethics, transparency, and accountability team at Twitter, thinks that all the attention that the AI safety discourse is generating will ultimately be beneficial to frontier labs. "[The companies] grab all the attention, time, energy, and money by spouting really extreme perspectives. But then they actually backtrack to where we sit, all while they discount all of our expertise," she says. "I think it's hard for normal people to think of how the mind of a venture capitalist works and these investors work. The scarier and more fantastic these CEOs make these companies seem, the more investors want in on it."

The US and China agree that advanced AI poses serious risks. But Beijing is deeply skeptical of a deal that prioritizes keeping US companies ahead. For years, many of the most powerful people in Silicon Valley have argued that the US is locked in an AI arms race with China, and that the consequences of losing would be disastrous. But over the past week, those same executives have started emphasizing a different message. AI has the potential to become so dangerous, tech leaders say, that the two countries urgently need to work together to slow the race down.

As OpenAI's Hugging Face incident has brought discussions about AI safety to the forefront, the company's CEO has clarified that it will not be looking to file for an initial public offering in 2026. In an interview with Fortune, Sam Altman said that "given everything happening with safety, right now would be an ill-advised moment to go public." In response to a question about OpenAI going public in 2026 or 2027, Altman said "not 2026," contradicting a report from earlier this year that the AI giant would file for an IPO as soon as September. Instead, Altman suggested that OpenAI will be focusing on AI safety and alignment, while still being interested in making improved models and products. Beyond the Hugging Face incident, OpenAI's agents reportedly once again broke out of testing environments to hack into two other organizations, RubyGems and DseWiki.

Anthropic's CEO warns that the makers of artificial intelligence "owe it to humanity to try" to slow down. Four days after a researcher publicly quit his job at Anthropic, warning that top AI firms are not "acting responsibly" and that their products might be on track to "kill us all," the company's CEO, Dario Amodei, seemed to basically agree. "We must slow the pace at which we improve the capabilities of AI models," Amodei wrote in a 3,800-word essay that he published today on his personal website and posted to social media. By now, we've all become accustomed to AI industry figures issuing dire prophecies about the power of their products. Yet Amodei's essay stands out for its urgency and for the moment at which it arrived.

One of AI's Fiercest Critics Says All the Doom Talk Is'Meant to Distract Us' Timnit Gebru argues that AI companies are stoking fears of extinction to avoid discussing actual harms, like autonomous weapons. Here at WIRED we've been trying to make sense of at least two incidents in the AI industry this week: First, the major fight over a million-dollar math problem and whether OpenAI surreptitiously borrowed the work of other researchers to solve the problem first. A day later, an Anthropic researcher--who had previously worked at OpenAI--very publicly quit his job, citing concerns about how both companies were handling AI safety. Another technical staffer at Anthropic said in response that people at the company "really do earnestly believe AI could kill all humans! I personally think it is >10% within the next decade."

OpenAI has announced the release of what it says is its most advanced AI model, amid heightened scrutiny of the risks of the frontier technology escaping human control. The $852bn start-up said in its announcement on Thursday that GPT 6 Astra, the "world's most intelligent and aligned" AI model, earned perfect or near-perfect scores in key benchmarks of AI reasoning, beating both its prior release GPT 5.6 Sol and rival Anthropic's Claude Fable 5. OpenAI's latest release comes as the AI industry is at the centre of a lively public debate about the dangers of the cutting-edge technology following the AI-led hacking of the startup Hugging Face in July. An independent probe into the cyberattack found that hundreds of OpenAI's AI agents had begun communicating among themselves before breaking out of their controlled environment and compromising Hugging Face's servers. On Thursday, US Senator Bernie Sanders, an Independent, and US House Representative Greg Casar, a Democrat, unveiled legislation that would pause the development of advanced AI until the establishment of federal safety rules and an outright ban on the creation of "superintelligent" AI. "Nearly every day, there is a frightening new story about how Big Tech companies are losing control of the technology they are developing, with potentially cataclysmic results," Sanders said in a statement announcing the legislation, which is unlikely to advance due to the Republicans' control of all three branches of the US government. "The leaders of the major AI companies publicly acknowledge that they do not fully understand the technology and that it is escaping their control. It is irresponsible for society to allow them to move forward and make these products even more advanced."

AI Agents Are Hacking Systems. Could That Push the US and China to Cooperate? The AI race has long been framed as a zero-sum game: Either the US or China will win in the end. But as concerns pile up around the increasing capabilities of AI models--especially AI agents--researchers in both countries are trying to team up to work on AI safety. This week, contributing editor Zoë Schiffer speaks with senior writer Will Knight about what he saw and heard on the ground when he visited China this summer--and why the two countries might actually need to start working together to avoid a major AI catastrophe. This is our second episode from our summer-break series. We'll be back next week with our usual roundtable. Write to us at [email protected] .